User terminal apparatus, display apparatus, user interface providing method and controlling method thereof

ABSTRACT

A user terminal apparatus is provided. The user terminal apparatus includes a communication interface unit which receives user interface (UI) information data regarding a UI screen corresponding to at least one application displayed on an external apparatus in communication with the external apparatus, a storage unit which stores a UI information conversion format, an information conversion unit which converts the received UI information data using the UI information conversion format, a display unit which displays a UI screen, and a control unit which controls the information conversion unit to convert the UI information data received by the communication interface unit using the UI information conversion format and display on the display unit the UI screen corresponding to the converted UI information data.

CROSS-REFERENCE TO RELATED APPLICATIONS

This is a continuation of U.S. application Ser. No. 14/507,326 filedOct. 6, 2014, which is a continuation of U.S. application Ser. No.13/244,494, filed Sep. 25, 2011 which claims priority from Korean PatentApplication No. 2011-0018663, filed in the Korean Intellectual PropertyOffice on Mar. 2, 2011, the disclosure of which is incorporated hereinby reference in their entirety. U.S. application Ser. No. 14/884,213filed Oct. 15, 2015 is another continuation of above U.S. applicationSer. No. 14/507,326.

BACKGROUND

1. Field

Methods and apparatuses consistent with exemplary embodiments relate toa user terminal apparatus, a display apparatus, a user interface (UI)providing method, and a controlling method thereof, and moreparticularly, to a user terminal apparatus providing a function ofcontrolling an external apparatus, a display apparatus, a UI providingmethod and a controlling method thereof.

2. Description of the Related Art

Various electronic apparatuses including a display apparatus may becontrolled by a remote controller.

With the development of functions of electronic apparatuses, the numberof control items in such electronic apparatuses has also increased.

In particular, a television which receives a broadcast signal hasvarious control modes as the number of channels increases due to theintroduction of digital broadcasting and a plurality of externalapparatuses are connected to the television. Accordingly, buttons in aremote controller have increased and become more complicated.

As control operations by a remote controller increase, a user may beprovided with more interfaces. However, the increased and complicatedcontrolling services provided by a display apparatus may createdifficulties to the user. Specifically, a user may not use a remotecontroller conveniently and should perform more complicated keymanipulation to use various services provided by a display apparatus.

Accordingly, a function of providing a user interface screen in moreforms and in an intuitive way is required.

SUMMARY

One or more exemplary embodiments provide a user terminal apparatusproviding an intuitive user interface screen corresponding to acurrently executed application, a display apparatus, a UI providingmethod and a controlling method thereof.

According to an aspect of an exemplary embodiment, there is provided auser terminal apparatus including a communication interface unit whichreceives UI information data regarding a user interface screencorresponding to at least one application displayed on an externalapparatus in communication with the external apparatus, a storage unitwhich stores a predetermined UI information conversion format, aninformation conversion unit which converts the received UI informationdata using the predetermined UI information conversion format, a displayunit which displays a user interface screen, and a control unit which,if the UI information data is received, controls to convert the receivedUI information data using the UI information conversion format anddisplay a user interface screen corresponding to the converted UIinformation data.

The user terminal apparatus may further include a user interface unitwhich receives a user command, and the control unit may control toexecute a remote controller application in accordance with the usercommand, search a connectable external apparatus, and display an iconcorresponding to at least one searched external apparatus.

The control unit may control to receive UI information data from anexternal apparatus corresponding to a selected icon from among iconscorresponding to the external apparatus.

The control unit which, if there is a predetermined event, may controlto convert UI information data corresponding to the predetermined eventusing the predetermined UI information conversion format and transmitthe converted UI information data to the external apparatus.

The user terminal apparatus may further include a movement sensing unitwhich senses a movement of the user terminal apparatus, and the controlunit which, if there is a movement of the user terminal apparatus aftera predetermined event occurs, may control an operation state of theexternal apparatus in accordance with a degree of a movement sensed bythe gradient sensing unit.

The display unit may be embodied as a touch screen, and thepredetermined event may be a touch event by a user.

A display apparatus, according to another exemplary embodiment, includesa communication interface unit which communicates with an externalapparatus, a display unit which displays a user interface screencorresponding to at least one application, an information generatingunit which generates UI information data corresponding to the userinterface screen, and a control unit which controls the communicationinterface unit to transmit the UI information data to the externalapparatus in accordance with a request from the external apparatus.

The information generating unit may generate the UI information data ina form of an extensible markup language (XML) document.

The information generating unit may be embodied as an application.

The control unit, if UI information data is received from the externalapparatus, may perform a control operation corresponding to the receivedUI information data.

According to an aspect of another exemplary embodiment, there isprovided a method for providing a UI of a user terminal apparatus, themethod including receiving UI information data regarding a userinterface screen corresponding to at least one application displayed onan external apparatus in communication with the external apparatus,converting the received UI information data using the predetermined UIinformation conversion format, and displaying a user interface screencorresponding to the converted UI information data.

The method may further include receiving a user command and executing aremote controller application in accordance with the user command,searching a connectable external apparatus, and displaying an iconcorresponding to at least one searched external apparatus.

The method may further include receiving UI information data from anexternal apparatus corresponding to a selected icon from among iconscorresponding to the external apparatus.

The method may further include, if there is a predetermined event,converting UI information data corresponding to the predetermined eventusing the predetermined UI information conversion format andtransmitting the converted UI information data to the externalapparatus.

The method may further include, if there is a movement of the userterminal apparatus after a predetermined event occurs, controlling anoperation state of the external apparatus in accordance with a degree ofsensed movement.

The display unit may be embodied as a touch screen, and thepredetermined event may be a touch event by a user.

According to an aspect of another exemplary embodiment, there isprovided a method for controlling a display apparatus, the methodincluding displaying a user interface screen corresponding to at leastone application, generating UI information data corresponding to theuser interface screen, and transmitting the UI information data to anexternal apparatus in accordance with a request from the externalapparatus.

The generating may include generating the UI information data in a formof an XML document.

The generating may be performed in the application.

The method may further include, if UI information data is received fromthe external apparatus, performing a control operation corresponding tothe received UI information data.

BRIEF DESCRIPTION OF THE DRAWINGS

The above and/or other aspects of the present disclosure will be moreapparent by describing certain exemplary embodiments with reference tothe accompanying drawings, in which:

FIG. 1 is a view to explain a display system according to an exemplaryembodiment;

FIG. 2 is a block diagram illustrating configuration of a displayapparatus according to an exemplary embodiment;

FIG. 3 is a block diagram illustrating configuration of a user terminalapparatus according to an exemplary embodiment;

FIGS. 4A and 4B are views to explain a conversion form of a userinterface screen according to an exemplary embodiment;

FIGS. 5A to 10B are views to explain a user interface screen accordingto various exemplary embodiments;

FIGS. 11A and 11B are views illustrating an example of UI datainformation according to various exemplary embodiments;

FIG. 12 is a flowchart to explain a method for controlling a displayapparatus according to an exemplary embodiment; and

FIG. 13 is a flowchart to explain a method for providing a UI of a userterminal apparatus according to an exemplary embodiment.

DETAILED DESCRIPTION

Certain exemplary embodiments are described in higher detail below withreference to the accompanying drawings.

In the following description, like drawing reference numerals are usedfor the like elements, even in different drawings. The matters definedin the description, such as detailed construction and elements, areprovided to assist in a comprehensive understanding of exemplaryembodiments. However, exemplary embodiments can be practiced withoutthose specifically defined matters. Also, well-known functions orconstructions are not described in detail since they would obscure theapplication with unnecessary detail.

FIG. 1 is a view to explain a display system according to an exemplaryembodiment.

According to FIG. 1, the display system according to an exemplaryembodiment comprises a display apparatus 100 and a user terminalapparatus or a mobile apparatus 200.

The display apparatus 100 according to an exemplary embodiment may beconfigured in various ways. The display apparatus 100 may be mainlyembodied as a smart television (TV), and in some cases, as a desktopcomputer, a notebook computer, a digital broadcast terminal, or anavigation. In this exemplary embodiment, it is assumed that the displayapparatus 100 is a smart TV for convenience of explanation.

The display apparatus 100 may be configured to receive various controlcommands from the mobile apparatus 200 in communication with the mobileapparatus 200. That is, the mobile apparatus 200 may function as aremote controller controlling the display apparatus 100.

In particular, the display apparatus 100 may operate at least oneapplication on its own and display a user interface screen correspondingto the operated application.

The user terminal apparatus 200 may be configured to operate and executeits own various applications. For example, the user terminal apparatus200 may be embodied as a smart phone, and depending on cases, the userterminal apparatus 200 may be any apparatus which can operate anapplication on its own such as a Personal Digital Assistant (PDA) and aPortable Multimedia Player (PMP).

In particular, the user terminal apparatus 200 may operate anapplication (hereinafter, a remote application) which performs afunction of a remote controller to control the external displayapparatus 100. Alternatively, the function of a remote controller tocontrol the external display apparatus 100 may be provided through aseparate control mode instead of a certain application.

Herein, the user terminal apparatus 200 may receive and transmit data incommunication with the display apparatus 100 via a network.Specifically, the user terminal apparatus 200 may communicate with thedisplay apparatus 100 according to various wired/wireless communicationtechnologies such as Wireless Fidelity (WI-FI), Internet, local areanetwork (LAN), Ethernet, TCP/IP, IPX, FireWire, IEEE 1394, iLink, CDMA,TDMA, BlueTooth (BT), High Definition Multimedia Interface (HDMI-CEC),Wireless HDMI-CEC, Radio Frequency (RF), and etc.

For example, if the user terminal apparatus 200 and the displayapparatus 100 are connected to the same sharer, a remote controllerfunction may be performed with regard to the display apparatus 100 asthe display apparatus 100 is searched according to a user's command or apredetermined event and thus, the display apparatus 100 is connected.

Hereinafter, configuration of a display apparatus according to anexemplary embodiment will be explained in detail.

FIG. 2 is a block diagram illustrating configuration of a displayapparatus according to an exemplary embodiment.

According to FIG. 2, the display apparatus 100 comprises a display unit110, an information generating unit 120, a communication interface unit130, a function block 140, and a control unit 150.

As illustrated above with regard to FIG. 1, the display apparatus 100may be configured to operate at least one application on its own.Accordingly, the display apparatus 100 may be mainly embodied as a smartTV, but is not limited thereto.

The display unit 110 may display a user interface screen correspondingto at least one application. Herein, the display unit 110 may beembodied as at least one of a liquid crystal display, a thin filmtransistor-liquid crystal display, an organic light-emitting diode, aflexible display, and a 3D display, but is not limited thereto.

The information generating unit 120 generates UI information datacorresponding to a user interface screen displayed on the display unit110.

Specifically, the information generating unit 120 may generate UIinformation data in the form of an XML document. Herein, the UIinformation data may include contents for composing UI and also contentsof UI. The specific form of an XML document will be explained indetailed with reference to a drawing.

Meanwhile, the function of the information generating unit 120 may beconfigured to be performed by a specific application. That is, UIinformation data corresponding to a user interface screen which iscurrently displayed on a specific application may be generated.Alternatively, UI information data corresponding to a user interfacescreen displayed on the display unit 110 in a currently-operatedapplication may be generated.

The communication interface unit 130 performs communication with anexternal apparatus (FIG. 1, 200). Herein, the external apparatus (FIG.1, 200) may be embodied as a mobile apparatus such as a smart phone, butis not limited thereto.

The function block 140 performs an original function of the displayapparatus 100. If the display apparatus 100 is a smart TV, the functionblock 140 performs a function of a smart TV, and if the displayapparatus 100 is a navigation, the function block performs a function ofa navigation guiding a path.

The control unit 150 controls overall function of the display apparatus100.

In particular, the control unit 150 controls the communication interfaceunit 130 to transmit UI information data generated by the informationgenerating unit 120 according to a request from the external apparatus(FIG. 1, 200) to the external apparatus (FIG. 1, 200).

In addition, the control unit 150 may control a storage unit (not shown)to temporarily store UI information data generated by the informationgenerating unit 120 in the storage unit (not shown) and transmit the UIinformation data to the external apparatus (FIG. 1, 200) upon a requestfrom the external apparatus (FIG. 1, 200).

If UI information data is received from the external apparatus (FIG. 1,200), the control unit 150 may also perform a control operationcorresponding to the received UI information data. Specifically, thecontrol unit 150 may check availability of the received UI informationdata and transmit the received UI information data to a correspondingblock (for example, a corresponding application) so that thecorresponding block can analyze the data and performs an appropriatefunction operation accordingly. The control unit 150 may generate acorresponding GUI if necessary.

Furthermore, the control unit 140 may control an operation of a UIprocessing unit (not shown) which will be explained later.

The UI processing unit (not shown) performs the operation ofprocessing/generating various UI images in the form of two-dimensional(2D) or three-dimensional (3D) images. Herein, the UI images may beimages for executing at least one application as described above.Alternatively, the UI images may be images displaying texts or figuressuch as menu, warning, time, channel number, and etc.

In addition, the UI processing unit (not shown) may perform 2D/3Dconversion, adjustment of transparency, color, size, shape, andlocation, creating highlight or animation effect, and etc under thecontrol of the control unit 150.

The storage unit (not shown) is a storage medium which stores variousprograms needed to operate the display apparatus 100 and may be embodiedas a memory or a Hard Disk Drive (HDD). For example, the storage unitmay include a read-only memory (ROM) for storing programs needed tooperate the controlling unit 150 and a random access memory (RAM) fortemporarily storing data regarding the operation of the controlling unit150. In addition, the storage unit may further include an ElectricallyErasable and Programmable ROM (EEROM) for storing various referencedata.

In addition, the display apparatus 100 may further include an imagereceiving unit (not shown) which receives a 2D or 3D image signaltransmitted wirelessly or via cables from a broadcasting station or asatellite and demodulates the received image signal and an imageprocessing unit (not shown) which performs operations of processingsignals such as video decoding, format analyzing, and video scaling andadding GUIs with respect to the received 2D or 3D image.

Hereinafter, the configuration of a user terminal apparatus according toan exemplary embodiment will be explained in detail.

FIG. 3 is a block diagram illustrating the configuration of a userterminal apparatus according to an exemplary embodiment.

According to FIG. 3, the user terminal apparatus 200 comprises a displayunit 210, a user interface unit 220, a communication interface unit 230,an application driving unit 240, a storage unit 250, and a control unit260.

The user terminal apparatus 200 may be configured to operate and executevarious applications. For example, the user terminal apparatus 200 maybe embodied as a smart phone, but is not limited thereto.

In particular, the user terminal apparatus 200 may operate anapplication (hereinafter, a remote application) which performs afunction of a remote controller to control the external displayapparatus 100. Alternatively, the function of a remote controller tocontrol the external display apparatus 100 may be provided through aseparate control mode instead of a certain application.

Herein, the user terminal apparatus 200 may transmit/receive variousdata in communication with the display apparatus 100 via network. Forexample, the user terminal apparatus 200 may communicate with WirelessFidelity (WI-FI), but the method of communication is not limitedthereto.

The display unit 210 displays various screens provided by the userterminal apparatus 200. Specifically, the display unit 210 may displayvarious data subjects and various user interface screens from the userterminal apparatus 200.

In particular, the display unit 210 may display a user interface screencorresponding to an application for controlling the display apparatus100 according to a predetermined event or a user command.

Herein, the display unit 210 may be embodied as at least one of a liquidcrystal display, a thin film transistor-liquid crystal display, anorganic light-emitting diode, a flexible display, and a 3D display.

Specifically, the display unit 210 may be embodied as a touch screenforming an interactive layer structure with a touch pad. In this case,the display unit 140 may be used as the user interface unit 220 whichwill be explained later. In addition, the touch screen may be configuredto detect not only the location and size of an input but also thepressure of the input.

The user interface unit 220 receives a user command to select andcontrol the above-mentioned control mode and application mode. Herein,the user interface unit 220 may be embodied as a touch screen integrallyformed with the display unit 210 as described above.

The communication interface unit 230 communicates with the displayapparatus 100.

Specifically, the communication interface unit 230 may receive UIinformation data regarding a user interface screen corresponding to atleast one application displayed on a display screen of the displayapparatus 100 from the display apparatus 100. For example, thecommunication interface unit 230 may receive UI information data fromthe display apparatus 100 via a network. Herein, the network may beembodied using various communication technologies such as Internet, LAN,WI-FI, Ethernet, TCP/IP, IPX, FireWire, IEEE 1394, iLink, CDMA, TDMA,BlueTooth (BT), High Definition Multimedia Interface (HDMI-CEC),Wireless HDMI-CEC, Radio Frequency (RF), and etc.

In addition, the communication interface unit 230 transmits datacorresponding to a user command or a predetermined event input throughthe user interface unit 230 to the user terminal apparatus 100.

The communication interface unit 230 may also offer a path through whichvarious application programs provided by the user terminal apparatus 200are downloaded.

A communication method that the user terminal apparatus 200 uses tocommunicate with the display apparatus 100 may be the same as ordifferent from a communication method that the user terminal apparatus200 uses to download an application.

The application driving unit 240 drives and executes an applicationprovided by the user terminal apparatus 200. Herein, the applicationrepresents a self-executable application program and may include variousmultimedia contents. Herein, the term of ‘multimedia contents’ includestext, audio, still image, animation, video, interactive content,Electronic Program Guide (EPG) content received from a content provider,an electronic message received from users, information regarding acurrent event, and control content, but are not limited thereto.

In particular, an application which is operated and executed in theapplication driving unit 240 may include a remote application forcontrolling an external apparatus. For example, a remote application fordisplaying a user interface screen to control the display apparatus 100may be included. In this case, the user interface screen may display auser interface screen which is the same as or similar to the userinterface screen displayed on the display apparatus 100.

The storage unit 250 stores various programs needed to operate the userterminal apparatus 200 and may be embodied as a memory or an HDD. Forexample, the storage unit 250 may include a ROM for storing programsneeded to operate the controlling unit 260 and a RAM for temporarilystoring data regarding the operation of the controlling unit 260. Inaddition, the storage unit 250 may further include an EEPROM for storingvarious reference data.

The storage unit 250 may store a predetermined UI information conversionformat or a down-loaded application.

Herein, the predetermined UI information conversion format may representa format into which UI information data transmitted from the displayapparatus 100 is converted to correspond to the display format of theuser terminal apparatus 200.

That is, the storage unit 250 may store a conversion format into whichvarious UI information data transmitted from various display apparatuses100 supported by the user terminal apparatus 200 is converted tocorrespond to the display format of the user terminal apparatus 200.

In addition, the storage unit 250 may store identification information,state information of each operation, and information of control screencorresponding to each operation state of the display apparatus 100 to becontrolled, and provide a control screen corresponding to a state of thedisplay apparatus 100 based on the stored information.

The information conversion unit 260 converts UI information datareceived through the communication interface unit 230 using apredetermined UI information conversion format stored in the storageunit 250.

Specifically, the information conversion unit 260 converts UIinformation data received through the communication interface unit 230using a predetermined UI information conversion format so that thereceived UI information data may comply with the display format of theuser terminal apparatus 200.

The control unit 270 controls overall operation of the user terminalapparatus 200.

In particular, if UI information data is received from the displayapparatus 100, the control unit 270 may control the informationconversion unit 260 to convert the received UI information data using apredetermined UI information conversion format stored in the storageunit 250 and display a user interface screen corresponding to theconverted UI information data.

In addition, the control unit 270 may control the user interface unit220 to execute a remote controller application according to a usercommand input through the user interface unit 220, searches aconnectable external apparatus, and display an icon corresponding to atleast one searched external apparatus on the display unit 210.

The control unit 270 may also control the communication interface unit230 to receive UI information data from an external apparatuscorresponding to a selected icon from among icons corresponding toexternal apparatuses displayed on the display unit 210.

If there is a predetermined event (or a user command), the control unit270 may control to convert UI information data corresponding to thepredetermined event (or the user command) using a predetermined UIinformation conversion format and transmit the converted UI informationdata to an external apparatus.

In addition, the control unit 270 may control an operation of a UIprocessing unit (not shown) which will be explained later.

The UI processing unit (not shown) performs the operation ofprocessing/generating various UI images in the form of 2D or 3D images.Herein, the UI images may be images for executing at least oneapplication as described above. Alternatively, the UI images may beimages displaying texts or figures such as menu, warning, time, channelnumber, and etc.

In addition, the UI processing unit (not shown) may perform 2D/3Dconversion, adjustment of transparency, color, size, shape, andlocation, creating highlight or animation effect, etc., under thecontrol of the control unit 150.

Albeit not shown in the drawing, the user terminal apparatus 200 mayfurther include a movement or gradient sensing unit (not shown).

The movement sensing unit (not shown) senses a movement of the userterminal apparatus 200. Herein, the movement may be a movement in up anddown/right and left directions.

In this case, if there is a movement of the user terminal apparatus 200after a predetermined event occurs, the control unit 270 may control anoperation state of the display apparatus 100 according to a degree ofthe movement sensed by the gradient sensing unit (not shown). Herein,the predetermined event may be a touch event by a user, but is notlimited thereto.

An operation state of channel up/down or volume up/down in the displayapparatus 100 may be controlled according to a movement of a userterminal apparatus, but is not limited thereto.

Meanwhile, if a remote controller operation with respect to the displayapparatus 100 is performed in accordance with execution of a remoteapplication, the control unit 270 may control to execute otherapplications being executed previously in a background mode. Forexample, if a remote controller operation with respect to the displayapparatus 100 is performed as a remote application is executed while agame application is being executed, the game application is executed ina background mode and may return to a previous state if the execution ofthe remote application is completed.

The user terminal apparatus 200 may include an exclusive button unit(not shown) indicating that a remote controller function is beingexecuted. In some cases, the exclusive button unit (not shown) mayfunction as a mode conversion button unit serving as a remotecontroller. That is, the functions of a remote controller may beperformed not only by a corresponding remote application but also by theexclusive button unit (not shown) which is provided separately.

Herein, if the exclusive button unit (not shown) is embodied in the formof a soft button, the exclusive button unit may be embodied as a part ofuser interface unit (220) in the form of touch screen as describedabove.

In addition, the exclusive button unit (not shown) may be embodied inthe form of a hard button, and in this case, the exclusive button unitmay be provided in a separate area from the user interface unit 220.

Meanwhile, the user terminal apparatus 200 may receive variousapplications not only from a network as described but also from anexternal memory (not shown) or an internal memory (not shown). Theinternal memory (not shown) may include a computer memory such as a RAM,a flash memory, and a ROM, but is not limited thereto Likewise, theexternal memory (not shown) may include an HDD, a Compact Disc (CD) ROM,a memory card, and a Universal Serial Bus (USB) flash drive, but is notlimited thereto.

FIGS. 4A and 4B are views to explain a conversion form of a userinterface screen according to an exemplary embodiment.

FIG. 4A illustrates a user interface screen displayed on the displayapparatus 100, and FIG. 4B illustrates a user interface screen displayedon the user terminal apparatus 200.

That is, as illustrated in FIG. 4A, the user interface screen displayedon the display apparatus 100 may be displayed on the user terminalapparatus 200 through the above-described data format conversionoperation as illustrated in FIG. 4B.

FIGS. 5A to 5E are views to explain a user interface screen according tovarious exemplary embodiments.

As illustrated in FIGS. 5A to 5D, if a remote controller function isexecuted, the user terminal apparatus 200 may provide various userinterface screens including a channel/volume manipulation screen (FIG.5A), a number input screen (FIG. 5B), a mecha-key input screen (FIG.5C), a hot-key providing screen (FIG. 5D), and etc.

According to FIG. 5E, if a remote controller function is executedthrough a remote application, the user terminal apparatus 200 maydisplay icons corresponding to a menu providing various functions.

The menu of “TV Remote” may be a menu for providing a user interfacescreen corresponding to an application displayed on the displayapparatus 100.

The menu of “Gesture Remote” may be a menu for manipulatingchannel/volume of the display apparatus 100 after touching and tilting ascreen.

The menu of “Keyboard” may be a menu for inputting a text when it isnecessary to input a text in the display apparatus 100.

The menu of “Game Remote” may be a menu for providing an internet gameusing the display apparatus 100.

The menu of “Manual” may be a menu for providing description regardingbasic function and usage of a remote application for performing a remotecontroller function.

The menu of “Setting” may be a menu for providing setting functionsneeded to use a remote application for performing a remote controllerfunction.

FIGS. 6A to 6E are views to explain operations of a remote applicationaccording to an exemplary embodiment.

As illustrated in FIG. 6A, if a remote application is executed in theuser terminal apparatus 200, a display apparatus connected to the sameaccess point (AP) may be searched as illustrated in FIG. 6B.

FIG. 6C may be a main screen when a selected display apparatus isconnected and enters into the AP for the first time. As illustrated inFIG. 6C, the main screen may be the same screen as the one illustratedin FIG. 5E. Since each menu has been explained in detail with regard toFIG. 5E, further description will not be provided.

FIG. 6D may be a basic control screen which is provided when “TV Remote”menu is selected.

FIG. 6E may be a screen which is displayed for the first time when anapplication-exclusive menu (“SMART HUB”) is entered into in a screenillustrated in FIG. 6D. As illustrated in FIG. 6E, a screen formanipulating various applications provided by the display apparatus 100may be displayed on a screen of the user terminal apparatus 200.

FIGS. 7A to 7D are views illustrating various user interface screensprovided by an application-exclusive menu according to an exemplaryembodiment.

As illustrated in FIG. 7A, a main screen of an application-exclusivemenu may be a screen which displays various applications provided by thedisplay apparatus 100 in a list.

FIG. 7B illustrates a user interface screen when a “search” widget isexecuted.

FIG. 7C illustrates an example of a detailed user interface screen whena specific application (for example, YouTube) is executed.

As illustrated in FIG. 7C, navigation among a plurality of contentsprovided by a specific application through a provided user interfacescreen are possible.

FIG. 7D illustrates an example of a user interface screen when a contentis selected after a specific application (for example, YouTube) isexecuted.

As illustrated in FIG. 7D, manipulation of a content becomes easierusing a provided user interface screen.

Meanwhile, as illustrated in FIGS. 7A to 7E, the above-describedexclusive button unit may be activated if an application-exclusive menuis provided.

FIGS. 8A to 8C are views illustrating a user interface screen which isprovided when a specific menu is selected according to an exemplaryembodiment.

As illustrated in FIG. 8A, if there is a predetermined event such as atouch event, the user terminal apparatus 200 may perform the function of“Gesture Remote” illustrated in FIG. 5E.

In this case, as illustrated in FIG. 8B, up/down of channel or volume ofthe user terminal apparatus may be adjusted by tilting the user terminalapparatus up and down or right and left.

FIG. 8C illustrates a user interface screen during the adjustment inFIG. 8B.

FIGS. 9A and 9B illustrate user interface screens providing a game mode(“Game Remote” menu illustrated in FIG. 5E) according to an exemplaryembodiment.

FIGS. 10A and 10B illustrate user interface screens providing a textinput mode (“Keyboard” menu illustrated in FIG. 5E) according to anexemplary embodiment.

FIGS. 11A and 11B are views illustrating an example of UI datainformation according to various exemplary embodiments.

As illustrated in FIGS. 11A and 11B, UI data information generated by adisplay apparatus may be an XML document.

The XML data illustrated on the left side of FIG. 11A may generate auser interface screen, which has a configuration as that on the right ofFIG. 11A, on the user terminal apparatus 200.

In addition, the XML data illustrated on the left of FIG. 11B maygenerate a user interface screen, which has a configuration as that onthe right of FIG. 11B, on the user terminal apparatus 200.

FIG. 12 is a flowchart to explain a method for controlling a displayapparatus according to an exemplary embodiment.

According to the display apparatus controlling method illustrated inFIG. 12, first of all, a user interface screen corresponding to at leastone application is displayed (S1210).

Subsequently, UI information data corresponding to the user interfacescreen is generated (S1220). In this case, the operation of generatinginformation (S1220) may be performed in a corresponding applicationprogram.

The UI information data is transmitted to an external apparatus upon arequest from the external apparatus (S1230). In this case, the UIinformation data may be generated in the form of an XML document.

If UI information data is received from an external apparatus, a controloperation corresponding to the received UI information data may beperformed. Specifically, availability of received UI information datamay be checked and then transmitted to a corresponding block (forexample, a corresponding application), and the corresponding block mayperform an appropriate function operation by analyzing the received UIinformation data. In addition, if necessary, a GUI may be generated.

FIG. 13 is a flowchart to explain a method for providing a UI of a userterminal apparatus according to an exemplary embodiment.

According to the method for providing a UI of a user terminal apparatusillustrated in FIG. 13, UI information data regarding a user interfacescreen corresponding to at least one application displayed on anexternal apparatus is received in communication with the externalapparatus (S1310).

Subsequently, the received UI information data is converted using apredetermined UI information conversion format (S1320).

Subsequently, a user interface screen corresponding to the converted UIinformation data is displayed on a screen (S1330).

In addition, if a user command is input, a remote controller applicationmay be executed in accordance with the input user command, a connectableexternal apparatus may be searched, and an icon corresponding to atleast one searched external apparatus may be displayed.

UI information data may be received from an external apparatuscorresponding to a selected icon from among icons corresponding to theexternal apparatus

If there is a predetermined event or a user command, UI information datacorresponding to the predetermined event may be converted using apredetermined UI information conversion format and transmitted to anexternal apparatus.

If there is a movement of a user terminal apparatus after apredetermined event occurs, an operation state of an external apparatusmay be controlled according to the degree of the sensed movement.

In this case, a display screen may be embodied as a touch screen, andthe predetermined event may be a touch event by a user.

In the exemplary embodiment, a computer-readable-recording-mediumincluding a program for executing the above-described method forcontrolling a display apparatus and a method for providing a UI of auser terminal apparatus may be included. The recording medium readableby a computer includes all kinds of recording media where data readableby a computer system is stored. The recording medium readable by acomputer includes ROM, RAM, CD-ROM, magnetic tape, floppy disk, opticaldata storage apparatus, and etc. Meanwhile, the recording mediumreadable by a computer may be distributed in a computer system connectedvia a network, and may store and execute a code readable by a computerusing a distribution method.

According to the exemplary embodiment described above, an applicationmay be easily manipulated and a content navigation may be easilyperformed in a display apparatus though a remote controller function.

Although a few exemplary embodiments have been shown and described, itwould be appreciated by those skilled in the art that changes may bemade to the exemplary embodiments without departing from the principlesand spirit of the inventive concept, the scope of which is defined inthe claims and their equivalents.

What is claimed is:
 1. A display apparatus controlled by an externalapparatus, the display apparatus comprising: a display; a communicationinterface; and a processor configured to: display on the display a userinterface (UI) screen related to at least one application among aplurality of applications which is executed on the display apparatus;obtain UI information data related to the UI screen; and control thecommunication interface to transmit the obtained UI information data tothe external apparatus.
 2. The apparatus as claimed in claim 1, whereinthe processor is further configured to control the application togenerate the UI information data.
 3. The apparatus as claimed in claim1, wherein the UI information data is used for obtaining a UI screenprovided on the external apparatus by a remote application which isexecuted in the external apparatus to control the display apparatus. 4.The apparatus as claimed in claim 3, wherein the processor is furtherconfigured to provide, in response to another UI information datareceived from the external apparatus, the other UI information data withthe remote application.
 5. The apparatus as claimed in claim 1, whereinthe processor is further configured to control, in response to anotherUI information data received from the external apparatus, a functionblock related to the other UI information data based on the other UIinformation data.
 6. The apparatus as claimed in claim 1, wherein theprocessor is further configured to: transmit UI information regardingthe plurality of applications provided by the display apparatus to theexternal apparatus; and execute, in response to a control signalselecting an application among the plurality of applications, theselected application.
 7. A method of controlling a display apparatuscontrolled by an external apparatus, the method comprising: displayingon a display a user interface (UI) screen related to at least oneapplication among a plurality of applications which is executed on thedisplay apparatus; obtaining UI information data related to the UIscreen; and transmitting the obtained UI information data to theexternal apparatus.
 8. The method as claimed in claim 7, wherein theobtaining the UI information comprises obtaining the UI information datagenerated by the application.
 9. The method as claimed in claim 7,wherein the UI information data is used for obtaining a UI screenprovided on the external apparatus by a remote application which isexecuted in the external apparatus to control the display apparatus. 10.The method as claimed in claim 9, further comprising; providing, inresponse to another UI information data received from the externalapparatus, the other UI information data with the remote application.11. The method as claimed in claim 7, further comprising controlling, inresponse to another UI information data received from the externalapparatus, a function block related to the other UI information databased on the other UI information data.
 12. The method as claimed inclaim 7, further comprising; transmitting UI information regarding theplurality of applications provided by the display apparatus to theexternal apparatus, and executing, in response to a control signalselecting an application among the plurality of applications, theselected application.
 13. A non-transitory computer readable mediumwhere an application which is controlled by an external apparatus isstored, wherein the application performs a method comprising: providinga user interface (UI) screen related to at least one application among aplurality of applications which is executed on the display apparatus;obtaining UI information data related to the UI screen; and providingthe obtained UI information data to the external apparatus.